(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
25 July 2002 (25.07.2002) 




PCT 



(10) International Publication Number 

WO 02/057951 A2 



(51) International Patent Classification 7 : G06F 17/30 

(21) International Application Number: PCT/CA02/00048 

(22) International Filing Date: 18 January 2002 (18.01.2002) 

(25) Filing Language: English 

(26) Publication Language: English 

(30) Priority Data: 

09/764,418 19 January 2001 (19.01.2001) US 

(71) Applicant and 

(72) Inventor: TULI, Raja [CA/CA]; 555 Rene Levesque 
West, Suite 1 130, Montreal, Quebec H2Z IB I (CA). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FT, GB, GD, GE, GH, 



GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, OM, PH, PL, PT, RO, RU, SD, SE, SG, 
SI, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, 
VN, YU, ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, CH, CY, DE, DK, ES, FT, FR, 
GB, GR, TE, IT, LU, MC, NL, PT, SE, TR), OAPI patent 
(BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, ML, MR, 
NE, SN, TD, TG). 

Published: 

— without international search report and to be republished 
upon receipt of that report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: PORTABLE HTGH SPEED INTERNET ACCESS DEVICE 



20- 
18- 



< 

in 
t> 

o 




11 r-A r-2 




(57) Abstract: The invention relates to a host computer system which receives information, rasterizes it, compresses it and transmits 
it to a portable device which decompresses the image to display it on a screen. The image can be decompressed in whole or in parts 
to be viewed as the used scrolls through the image. An electronic touch screen keyboard is featured, which is used to input text 
characters in a text area on the screen of the device. Thereafter, text is transmitted to specific areas on a virtual browser in the host 
computer as a string of characters, or individually, with refreshed images of the virtual browser sent back to the device for each 
transmission. The CPU of the PDA renders each text character on the display of the device for the user to view instantly, by making 
a bitmap. The host computer system is also capable of translating locations on the touch screen of the device into text characters 
or commands. The image received by the virtual browser is compressed in different amounts, with text and graphics compressed 
separately in different ways to be sent to the device, which can store and view received images. Icons on the device representing 
commands can be linked to icons or menu items on the virtual browser, by the device translating and linking to the host computer, 
or by the host computer translating. 
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PORTABLE HIGH SPE ED INTERNET ACCESS DEVICE 

"This application is a continuation in part of application number 09/496 172 
filed on 02/02/2000." ' 

BACKGROUND OF THE INVENTION 

5 

Field of the Invention 

The invention relates to a host computer system, which receives information, 
rasterizes it, compresses it and transmits it to a portable device which 
10 decompresses the image to display it on a screen. The result is a cost effective 
Internet access solution which allows interaction between the device and a host 
computer. 



Description of the Prior Art 

15 

The background of the present invention includes US Patent # 5925103, Internet 
Access Device, which describes an improved Internet access system, vastly 
different from the present invention. Other prior art would include palm top 
computers, hand-held computers and cellular telephones that have limited 
20 processing power due to design restrictions. Thus, these computers are much 
slower for accessing the Internet and World Wide Web. 
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SUMMARY OF THE INVENTION 

The present invention relates to a portable high speed Internet access device 
that can access the internet and World Wide Web as a wireless device. 

A principal embodiment has a Web server connected to the Internet. This server 
5 contains a virtual browser which takes the image displayed in the browser and 
converts this image into a bit map which is compressed, and communicates via 
telephone lines to a cellular telephone. The cellular telephone is connected to 
the high speed internet access device of the invention commonly referred to as a 
PDA (Personal Digital Assistant) which is comprised of a display screen, battery 

10 and related micro-electronics. This enables the PDA to receive, decompress and 
view the bit map image sent from the virtual browser, and more importantly, 
through cellular phone connectivity to be able to input data from the PDA directly 
onto the server. In particular, the host computer or server receives vector 
information or compressed data in the form of HTML, JPEG, etc., which is 

15 displayed on a web page. The virtual browser virtually displays a virtual image 
on the server. That image, in whole or parts, is recompressed and sent to the 
PDA. The recompressed data format sent to the PDA, is not necessarily in the 
same format as the compressed data format first received by the server. 

Another embodiment of the invention involves the server receiving vector 
20 information such as HTML or text and then rasterizing it to bit map format. It can 
then shown in memory through the virtual browser and is recompressed through 
a "loss less" method and sent to the PDA. 

One embodiment of the invention comprises the PDA with an electronic touch 
screen keyboard, which remains invisible and only appears on a portion of the 
25 display screen when called upon by touching the keyboard icon. The entire 
display screen is covered with a transparent touch panel, which is essentially a 
matrix array of electrodes, which can detect the location of any pressure points 
applied to it. The keyboard disappears when touching a minimizing icon, 
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revealing a refreshed image of the virtual browser. When the user is viewing the 
image displayed by a virtual browser on the PDA, and a text message needs to 
be entered at a specific location on the display, the user would have to point to 
this specific location, and pressing on the display screen's touch panel with a 
stylus tip, the cursor appears at that exact location, ready to input text. The 
keyboard would then be activated by pressing on the keyboard icon with a stylus 
tip, whereby a miniature keyboard layout would appear at the bottom of the 
display screen, with a portion of the display screen above the keyboard layout 
reserved to view text messages generated by the user, to be inputted in the 
image of the virtual browser at a later time. As the user enters text characters by 
pressing on various locations of the touch panel above the keyboard layout, the 
text message appears in the area above the keyboard, and when the user is 
finished inputting text, pressing on the send or return icons would send the entire 
text message to the specific location on the web page as viewed through the 
virtual browser on the server. The CPU of the PDA renders each text character 
on the display of the device for the user to view instantly, by making a bitmap. 
The PDA device translates strokes on the touch panel above the keyboard layout 
into characters, and the message is sent as a string of characters. A refreshed 
portion of virtual browser is sent back to the PDA, which displays the specific 
portion of the virtual browser that text was entered into, to verify that text was 
inputted at the correct location. 

In a further embodiment of the invention, an automatic keyboard feature is 
available to the user when scrolling through the image of the virtual browser on 
the PDA, and a text message is to be entered at a specific location. The user 
would point at the desired location to enter text and a keyboard layout 
automatically appears ready for text input. As text is typed, the text message 
appears in the area above the keyboard layout, and after the send or return icons 
are selected, the keyboard layout disappears and the message is sent to the 
specific location on the virtual browser. The CPU of the PDA renders each text 
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character on the display of the device for the user to view instantly, by making a 
bitmap. 

In another embodiment, which communicates with the virtual browser in a similar 
fashion, the method of text transfer to the virtual browser is different. The display 

5 screen would have the keyboard layout at the bottom, with two smaller areas 
above, one of which displays text characters comprising the message being 
typed, and the other area displaying a background portion of the virtual browser. 
For each text character that is selected and appears in the text area, a message 
is sent to the virtual browser that tells which character is typed, and that specific 

10 text character is entered in the virtual browser in the portion of the image 

selected for text input. The CPU of the PDA renders each text character on the 
display of the device for the user to view instantly, by making a bitmap. A 
refreshed portion of virtual browser is sent back to the PDA, which displays the 
specific portion of the virtual browser that text was entered into, to verify that text 

15 was inputted at the correct location. 

In a further embodiment, which communicates with the virtual browser in a 
similar fashion, the method of text transfer to the virtual browser is different. The 
display screen would have the keyboard layout at the bottom, with two smaller 
areas above, one of which displays text characters comprising the message . 

20 being typed, and the other area displaying a background portion of the virtual 
browser. For each text character that is inputted in the text window, a message 
is sent to the virtual browser informing of the specific matrix location selected on 
the keyboard window. This matrix location is translated at the server end to 
determine what character is selected as the mapped layout of each character on 

25 the PDA keyboard is known, and this character entered in the virtual browser at 
the specific location selected. The CPU of the PDA renders each text character 
on the display of the device for the user to view instantly, by making a bitmap. A 
refreshed portion of virtual browser is sent back to the PDA, which displays the 
specific portion of the virtual browser that text was entered into, to verify that text 

30 was inputted at the correct location. 
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In another embodiment of the invention, an external keyboard is featured which 
is used to enter text characters as required. The keyboard interface can be wired 
or wireless. When the user wishes to enter text in the virtual browser, the 
specific location is selected by pressing on the touch panel and a text window 
appears in a portion of the display screen ready for text input. The keyboard 
connected to the PDA is then used to input text, and when the enter key is 
pressed, the message gets sent and the text window disappears. The text 
message is entered in the virtual browser at the specific location selected. The 
CPU of the PDA renders each text character on the display of the device for the 
user to view instantly, by making a bitmap. A refreshed portion of virtual browser 
is sent back to the PDA, which displays the specific portion of the virtual browser 
that text was entered into, to verify that text was inputted at the correct location. 

In other embodiments of the invention, the image displayed in the virtual browser 
is compressed at the server in various amounts by different methods before 
sending to the PDA device. 

Different parts of the image are compressed in different ways. Parts of the image 
that is text image are compressed by G4 compression techniques. Other parts of 
the image containing pictures are compressed by JPEG compression 
techniques. The entire image is converted to a raster image but different parts 
are converted at different depths of color. Text portions can be compressed by 
"loss less" techniques, which will result in complete image reproduction with no 
errors in text upon decompression, whereas pictures can be compressed by 
"lossy" techniques which upon decompression give a slightly degraded image 
quality for each compression. An image with black and white text and color 
graphics portions would be converted to a raster image/but only the text part of it 
reduced to black and white 1 bit and other graphics parts to 24 bit or other color 
raster images. Hence different parts of the image can be converted or reduced 
to different depths of color to resemble an actual web page with picture in color 
and text in black and white. The depths of color can be set by the user 
depending on the quality of image required, which affects the speed of refreshing 
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the screen which also depends on the amount of graphics displayed. Text and 
pictures from a web page would get compressed separately at the server and 
then sent to the PDA. In the PDA, text or black and white portions of the image 
get decompressed first and displayed on the screen. Color portions get 
decompressed and are overlain in the image on the screen shortly after, enabling 
the user to view black and white portions of the image in advance. 

A further embodiment would take the entire image to be viewed including all text 
and pictures and convert it to 1 bit raster. This file is compressed by G4 or other 
loss less compatible methods and sent to the PDA. When received by the PDA, 
this file is decompressed for the user to view the image, and the black and white 
portions are displayed first which can be done quickly and the graphics portions 
are overlaid progressively with color. This enables an image to be viewed 
quickly without the fine details of graphics, which follow moments after. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is described in more detail below with respect to an illustrative 
embodiment shown in the accompanying drawings in which: 

Fig. 1 illustrates elements in the host computer, which communicates with a 
remote user and the device of the invention. 

Fig. 2 illustrates the image to be displayed compared with the displayable area of 
a browser window. 

Fig. 3 shows a typical subdivision of the image to be displayed. 

Fig. 4 illustrates file formats received and sent by the host computer. 

Fig. 5 illustrates the displayable area of the device with respect to portions of the 

image, which are sequentially decompressed prior to viewing. 

Fig. 6 illustrates the display screen of the device with a stylus tip used to select 

icons or other elements in the display. 

Fig. 7 illustrates the display of the device containing a keyboard layout. 

Fig. 8 illustrates the display of the device containing a keyboard layout and a text 

area. 

Fig. 9 illustrates the device interfaced with an external keyboard layout. 

Fig. 10 illustrates the display of the device containing a keyboard layout with 

saved files represented by icons. 

Fig. 11 illustrates icons on the device and icons on the host computer. 
Fig. 12 illustrates an external keyboard for faster character entry. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

To facilitate description, any numeral identifying an element in one figure 
will represent the same element in any other figure. 

5 The principal embodiment of the present invention aims to provide a device that 
allows a user to access the Internet or the World Wide Web (WWW), which is a 
device similar to a palm top computer. It is a further aim of the present invention, 
to offer a cost-competitive device. It is a further aim of the present invention, to 
increase the speed of refreshing the screen when the user clicks on a link and 

10 commands another page to be displayed. 

Currently, existing palm top devices such as the Palm Pilot VII and Windows CE 
type devices contain an operating system, and within the operating system a 
mini-browser to interpret information received from the WWW or Internet and 
15 then display this information on the screen. This requires a powerful 

microprocessor, which is not advantageous in conserving power for portable 
applications and also minimizing costs. 

With reference to applications 09/496,172, 09/501,585, 09/504,809, 09/504,808 
20 and 09/504,807 whose embodiments are incorporated herein, the present 

invention discloses a method and system of storing previously viewed pages on 
the device. Thus a user is able to utilize a pointer or stylus tip to select and press 
a "back" button or a "forward" button to view previously accessed pages, and 
which pages are stored directly in the device. The invention further discloses a 
25 method of enabling the used to scroll to a specific area thereby initiating 

downloading in that area, or by the user clicking on a specific area to initiate the 
downloading. 

The principal embodiment of the present invention is disclosed in Figure 1. A 
30 host computer 1 is depicted which is connected to the Internet, and that host may 

8 
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also be a Web server. Running in the host computer, is a Web server program 2. 
When a remote user 3 requests to view a Web page (or electronic message etc.) 
the Web server software receives HTML, JAVA, or other types of information and 
transmits this information to another software, the Browser Translator 4. This 
5 software translates the information, (i.e. the entire image comprising graphics 
and text) received in the form of HTML, Java, etc. (as information may be 
gathered from different sources) and translates it to a black and white bit map or 
raster image. In another embodiment, the software translates the information 
into a raster or color image. The image 5, as shown in Figure 2, contains the 
10 information that would normally be displayed on a single Web page. The 
translation program therefore, also acts as a virtual browser 6. As can be seen in 
Figure 2, the image 5 to be displayed in a browser window 6 is usually larger 
than the displayable area of the browser window 6. The cellular telephone 12 of 
Fig. 1 is connected to the high speed internet access device 18 of the invention 

15 commonly referred to as a PDA (Personal Digital Assistant) which is comprised 
of a display screen 19, battery and related micro-electronics. This enables the 
PDA to receive, decompress and view the bit map image sent from the virtual 
browser 6, and more importantly, through cellular phone connectivity to be able 
to input data from the PDA directly onto the server. In particular, the host 

20 computer or server receives vector information or compressed data in the form of 
HTML, JPEG, etc., which is displayed on a web page. The virtual browser 
virtually displays a virtual image on the server. That image, in whole or parts, is 
recompressed and sent to the PDA. The recompressed data format sent to the 
PDA, is not necessarily in the same format as the compressed data format first 

25 received by the server, as illustrated in Fig. 4. For example, the incoming data 
from a Web page may be in the form of JPEG, which is decompressed and 
displayed on the virtual browser together with everything else, such as text, etc. 
Complex data is received by the virtual browser which includes text, graphic 
images, Java, JPEG, Tiff, etc., which are all completely rendered entirely onto a 

30 virtual display in the browser's memory. What is therefore rendered in the 
memory is all text and graphics portions combined into a single image. 
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The color depth of this rendered image is reduced and this reduced image 
is further subdivided into smaller segments, with each segment bearing no 
relation to or limited only to text or graphic portions. These subdivided 
segments are recompressed and sent to the PDA but can be in the form of TIFF 
5 G4 or other formats, and not necessarily in the format as initially received, in this 
particular embodiment. The PDA would receive all compressed segments and 
store them in memory, which are all decompressed and assembled in order to 
display the original image. 

Another embodiment of the invention involves the server receiving vector 
10 information such as HTML or text and then rasterizing it to bit map format. It can 
then shown in memory through the virtual browser and is recompressed through 
a "loss less" method and sent to the PDA. 

The image 5 of Fig. 2 is further divided into sections 7, 8, 9, and 10, as shown in 
15 Figure 3. The image is divided after the bitmap or raster is created. The reason 

for the division (as will be explained later) is for the purpose of display priority on 

the user's display. The image 5 is then sent to another program 11 running on 
. the host computer 1 (Fig. 1), which compresses the image using a loss-less 

compression method. The compression method may be group 3 or group 4, or 
20 another method. The programs 4 and 11 can have multiple instances running 

simultaneously on the host server for the purpose of connecting to multiple users. 

The compressed image, after being processed by program 11, is sent to the 

user, using a protocol in which information may be broken down into packets. 

i 

25 The information is received by the device 18 of the invention in Fig. 5 which has 
the ability to display a monochrome image 20, in its display window 19. The 
information is decompressed and displayed in the order of priority such that part 
of image 7 of Fig. 5, which substantially or completely covers the displayable 
area 19 of the device, is decompressed and displayed first and then sequentially 

30 the portions 8, 9 and 10 of the image are decompressed, and stored in an 

10 
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internal memory of the device to be displayed later when the user scrolls up, 
down, or sideways to these parts of the image. 

In a further embodiment, the information received from the server by the device 
18 of the invention in Fig. 5 remains compressed, and only the area viewed by 
the device is decompressed, since the area of a web page to be viewed is larger 
than the device's display area. As the user scrolls up, down or sideways, only 
the parts of the image to be displayed are decompressed prior to viewing. 

A CPU resident in the device therefore has the ability to decompress a bit map or 
raster image that may be larger than the size of the display and allow the user to 
traverse this bit map or raster image. The primary method of traversing the 
image is through conventional scroll bars positioned at the sides of the image. 
The resident CPU on the device has no ability to determine which part or parts of 
* the image, that is being displayed, represent links to other Web pages etc. Thus, 
the translator program 4 (Fig. 1) translates the image in the virtual browser 6 
such that the words that represent links on the page 5 (Fig. 2) are translated to 
be slightly bolder. The user may therefore consider text that is bold to be links. 

One embodiment of the invention comprises the PDA 18 of Fig. 6 with an 
electronic touch screen keyboard, which remains invisible and only appears on a 
portion of the display screen when called upon by touching the keyboard icon 21. 
The entire display screen 19 is covered with a transparent touch panel, which is 
essentially a matrix array of electrodes, which can detect the location of any 
pressure points applied to it. The keyboard disappears when touching a 
minimizing icon, revealing a refreshed image of the virtual browser. When the 
user is viewing the image displayed by a virtual browser on the PDA, and a text 
message needs to be entered at a specific location on the display.'the user 
would have to point to this specific location, and pressing on the display screen's 
touch panel with a stylus tip 22, the cursor appears at that exact location, ready 
to input text. The keyboard would then be activated by pressing on the keyboard 
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icon 21 with a stylus tip 22, whereby a miniature keyboard layout 23 would 
appear at the bottom of the display screen 19 of Fig. 7, with a portion of the 
display screen 24 above the keyboard layout reserved to view text messages 
generated by the user, to be inputted in the virtual browser at a later time. As the 
5 user enters text characters by pressing on various locations of the touch panel on 
the keyboard layout, the PDA 18 renders immediately what is typed for the user 
by creating a bitmap and showing it on the display screen 19. Initially when a 
message is being typed it is all rendered by the CPU of the device, which is not 
the final version of how the message gets entered in the web page, as this is only 

10 an initial rendered display of the message which allows text editing at this stage 
before the message is finally sent to the host computer. The text message 
appears in the area 24 above the keyboard, and when the user is finished 
inputting text, pressing on the send or return icon's would send the entire text 
message as a string of text characters to the host computer at the specific 

15 location on the web page, and not the bitmap sent to the host computer, at which 
time the server inserts text in the text area or text box in the virtual browser. The 
virtual browser takes a refreshed image of the web page, rasterizes or draws it in 
its memory. This refreshed portion of the virtual browser is sent back to the PDA 
as an image, which displays the specific portion of the virtual browser that text 

20 was entered into, to verify that text was inputted at the correct location. 

In another embodiment of the invention, as each text character is rendered on 
the display of the device by the onboard CPU, each particular text character is 
sent in the background to the host computer. Sending each text character to the 

25 host computer occurs simultaneously, or shortly after each text character is 
rendered on the display, without waiting for a response from the host computer. 
Text editing is possible at this stage, whereby a message is sent from the PDA to 
the host computer, advising of which text characters are to be replaced with new 
characters. At the end of inputting text characters, pressing on the send or return 

30 icon would send a message to the host computer that the send or return icon has 
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been clicked and a refreshed web page would be sent to the PDA to be 
displayed. 

The pointing device may be a touch screen or tracking ball, etc. As soon as the 
user clicks on part of an image, the shape of the pointer changes from an arrow 
to an hourglass. A message is sent to the host computer, transmitting the 
location of the clicked down event. A program 14 of Fig. 1 interprets the 
message and provides a virtual click down in the virtual browser created in the 
translator program 4. If the user has pressed or clicked in an area of the image 
that does not represent a link or text box, a message is dispatched to the device 
which immediately changes the hourglass shape of the pointer back to an arrow 
(in the case of a touch screen, from an hour glass to nothing). Further to this, if 
the user has pressed or clicked on a part of the image which represents a link, a 
new Web page is extracted from the Internet or WWW, translated by translator 
program 4 of Fig 1 into a bit map or raster, and compressed by compression 
program 11 and dispatched to the device where a new page is displayed. In a 
further embodiment, the image 5 of Fig. 2 may be continuously updated and 
translated and sent to the device where it is continuously being refreshed. This 
occurs once every few seconds. 

In a further embodiment of the invention, an automatic keyboard feature is 
available to the user when scrolling through the image of the virtual browser on 
the PDA, and a text message is to be entered at a specific location. The user 
would point at the desired location to enter text and a keyboard layout 23 of Fig. 
7 automatically appears ready for text input. How this happens is that a 
message gets sent to the host computer which knows the user has selected an 
area which can accept text, whereby the host computer responds with a 
message to the PDA device that it is ready to accept the keyboard entry 
sequence, at which time the PDA automatically pulls up the keyboard layout 
which appears at the bottom of the display screen 19. As text is typed, the text 
message appears in the area 24 above the keyboard layout, and the onboard 
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CPU of the PDA 18 renders immediately what is typed for the user, by creating a 
bitmap and showing it on the display screen 19. After the send or return icons 
are selected, the keyboard layout disappears and the message is sent as a string 
of text characters to the specific location on the virtual browser in the host 
computer, and not the bitmap sent to the host computer. A refreshed portion of 
the virtual browser is sent back to the PDA 18 as an image, which displays the 
specific portion of the virtual browser that text was entered into, to verify that text 
was inputted at the correct location. 

In another embodiment, which communicates with the virtual browser in a similar 
fashion, the method of text transfer to the virtual browser is different The display 
screen 19 of Fig. 8 would have the keyboard layout 23 at the bottom, with two 
smaller areas above, one being a text area 25 which displays text characters 
comprising the message being typed, and the other area 26 displaying a 
background portion of the virtual browser. For each text character that is 
selected and appears in the text area 25, a message is sent to the virtual 
browser 6 that tells which character is typed, and that specific text character is 
entered in the virtual browser in the portion of the image selected-for text input. 
The onboard CPU of the PDA 18 renders immediately what is typed for the user, 
by creating a bitmap and showing it on the display screen 19. The message that 
gets sent to the host computer is the actual text character and not the bitmap of 
it. A refreshed portion of the virtual browser is sent back to the PDA 18 as an 
image, which displays the specific portion of the virtual browser that text was 
entered into, to verify that text was inputted at the correct location. 

In a further embodiment, which communicates with the virtual browser in a 
similar fashion, the method of text transfer to the virtual browser is different. The 
display screen 19 of Fig. 8 would have the keyboard layout 23 at the bottom, 
with two smaller areas above, one is a text area 25 which displays text 
characters comprising the message being typed, and the other area 26 
displaying a background portion of the virtual browser. For each text character 
that is inputted in the text area 25, a message is sent to the virtual browser 6 
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informing of the specific matrix location selected on the keyboard window. This 
matrix location is translated at the server end to determine what character is 
selected as the mapped layout of each character on the PDA keyboard is known, 
and this character entered in the virtual browser at the specific location selected. 
The onboard CPU of the PDA 18 renders immediately what is typed for the user, 
by creating a bitmap and showing it on the display screen 19. A refreshed 
portion of the virtual browser is sent back to the PDA 18 as an image, which 
displays the specific portion of the virtual browser that text was entered into, to 
verify that text was inputted at the correct location. 

In another embodiment of the invention, an external keyboard 27 of Fig. 9 is 
featured which is used to enter text characters as required. The keyboard 
interface 28 can be wired or wireless. When the user wishes to enter text 
remotely in the virtual browser 6, the specific location for text entry is selected by 
pressing on the touch panel 19 directly over the text entry location, and a text 
window 29 appears in a portion of the display screen ready for text input. The 
text window is equipped with conventional scroll bars 30 which enable the user to 
have a wider viewing access, since the entire image sent from the virtual browser 
is decompressed and stored in the PDA. The keyboard connected to the PDA is 
then used to input text, and when the enter key is pressed, the message gets 
sent as a string of text characters and the text window 29 disappears. The 
onboard CPU of the PDA 18 renders immediately what is typed for the user, by 
creating a bitmap and showing it on the display screen 19. The message that 
gets sent to the host computer is the actual string text characters and not the 
bitmap of it. The text message is entered in the virtual browser at the specific 
location selected. A refreshed portion of the virtual browser is sent back to the 
PDA as an image, which displays the specific portion of the virtual browser that 
text was entered into, to verify that text was inputted at the correct location. 

In a further embodiment of the invention, an external keyboard 27 of Fig. 12 is 
also featured which is used to enter text characters as required. The keyboard 
interface 28 can be wired or wireless. When the user wishes to enter text 
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remotely in the virtual browser 6, the specific location for text entry is selected by 
pressing on the touch panel 19 of the PDA directly over the text entry location. 
For each text character that is directly inputted through the keyboard, a message 
is sent to the virtual browser 6 that tells it which character is typed, and that 
5 specific text character is entered in the virtual browser in the portion of the image 
selected for text input. The onboard CPU of the PDA 18 renders immediately 
what is typed for the user, by creating a bitmap and showing it on the display 
screen 19. A refreshed portion of the virtual browser is sent back to the PDA 18 
as an image, which displays the specific portion of the virtual browser that text 
10 was entered into, to verify that text was inputted at the correct location. 

In other embodiments of the invention, the image displayed in the virtual browser 
is compressed at the server in various amounts by different methods before 
sending to the PDA device. Different parts of the image are compressed in 
different ways. Parts of the image that are text images are compressed by G4 

15 compression techniques. Other parts of the image containing pictures are 

compressed by JPEG compression techniques. The entire image is converted to 
a raster image but different parts are converted at different depths of color. Text 
portions can be compressed by "loss less" techniques, which will result in 
complete image reproduction with no errors in text upon decompression, 

20 whereas pictures can be compressed by "lossy" techniques which upon 

decompression give a slightly degraded image quality for each compression. An 
image with black and white text and color graphics portions would be converted 
to a raster image, but only the text part of it reduced to black and white 1 bit and 
other graphics parts to 24 bit or other color raster images. Hence different parts 

25 of the image can be converted or reduced to different depths of color to resemble 
an actual web page with picture in color and text in black and white. The depths 
of color can be set by the user depending on the quality of image required, which 
affects the speed of refreshing the screen which also depends on the amount of 
graphics displayed. Text and pictures from a web page would get compressed 

30 separately at the server and then sent to the PDA. In the PDA, text or black and 
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white portions of the image get decompressed first and displayed on the screen. 
Color portions get decompressed and are overlain in the image on the screen 
shortly after, enabling the user to view black and white portions of the image in 
advance. At the browser, the priority of decompression is determined by the 
depth of color, with the minimum depth being decompressed first. 

A further embodiment would take the entire image to be viewed including all text 
and pictures and convert it to 1 bit raster. This file is compressed by G4 or other 
loss less compatible methods and sent to the PDA. When received by the PDA, 
this file is decompressed for the user to view the image, and the black and white 
portions are displayed first which can be done quickly and the graphics portions 
are overlaid progressively with color. This enables an image to be viewed 
quickly without the fine details of graphics, which follow moments after. 

In another embodiment of the invention, the user may save and store the 
rasterized Web pages in the memory of the device, and therefore be able to view 
offline - the stored rasterized pages; at a later time. The advantage of this 
embodiment is that the user does not have to connect to the host server to view 
the saved Web pages. 

In a further related embodiment, when not connected to the server the user can 
generate multiple text files which are stored in internal memory on the PDA 
device 18 of Fig. 10, which is equipped with flash RAM, a microprocessor, and 
related micro electronics. This is particularly useful in creating or responding to 
emails or other text related documents that are lengthy and may consume a lot of 
time to respond to. At a later time when the user is connected to the server, 
which has internet connection, the user can access an email account in which 
emails have to be responded to, or new ones sent. The exact location where text 
is to be entered in the virtual browser is selected with the stylus tip and the 
keyboard icon selected (or the keyboard appears automatically). The keyboard 
layout 23 appears at the bottom of the display screen 19 and a list of all saved 
files is displayed above this, represented by icons 31. Pointing on each icon 31 
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allows the user to review each saved file in the area 32 and when the enter or 
send icon is pressed on the keyboard, the selected file is sent to the exact 
location on the virtual browser. A refreshed portion of the virtual browser is sent 
back to the PDA as an image, which displays the specific portion of the virtual 
browser that text was entered into, to verify that text was inputted at the correct 
location. The user can then send the file as an email or store it on the server as 
done conventionally. 

In another embodiment of the invention, the server 1 contains the virtual browser 
6 displaying part of a web page 34 such that the virtual browser contains some of 
the icons 35 displayed in the display screen 19 of the PDA 18, as illustrated in 
Fig. 11 . These icons on the virtual browser may not be the same icons in the 
display screen of the PDA, but there are different ways to communicate between 
the PDA icons and the virtual browser's icons in conjunction with menu driven 
commands. The PDA may contain more icons than displayed on the virtual 
browser, so that an icon selected on the PDA screen may represent a command 
on the virtual browser not represented by an icon. In this particular embodiment, 
the PDA does the translation of which command is executed when a stylus is 
used to select an icon on the display screen's touch panel, and a message is 
sent to the virtual browser to execute that command at specific locations on the 
virtual browser. For example, pressing the "back" icon on the PDA 18 is 
translated by the PDA and this command linked to the "back" icon on the virtual 
browser 6, which can be in a different location. The PDA contains in its memory 
a mapped location address of all icons and menu commands on the server, so 
when an icon is selected on the display screen of the PDA, the PDA would link to 
the appropriate command or commands on the server, which are immediately 
executed. A single command executed from the PDA 18 can also represent a 
sequence of commands on both the PDA and the virtual browser 6. For 
example, when the address icon is selected on the PDA 18 a text box 36 
appears below and the keyboard automatically appears on the PDA display 
screen 19, ready to input data into the text box. The PDA 18 would link the 
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address in the text box 36 to the address box on the virtual browser and all text 
entered on the PDA gets inputted on the virtual browser. A single command 
executed from the PDA 18 can also be linked to menu driven commands on the 
virtual browser 6. For example, when the user wishes to change the font size on 
the PDA display screen whjch may not always be suitable for a variety of users, 
the font size icon 37 is selected from the display screen 19 and a link is made to 
pre-selected font sizes on the menu. items on the server. Hence, selecting the 
font size icon on the PDA screen would change the size of the font displayed on 
both the server and the PDA. Repeatedly selecting the font size icon takes the 
user progressively through all the pre-selected font sizes. 

In another related embodiment, the server 1 of Fig. 11 does all the translation of 
commands executed by the PDA 18 of the invention. Hence, the server has a 
mapped location of all icons on the PDA display screen 19. When a command is 
executed by pressing on the touch screen of the PDA, a message is sent to the 
server informing of the specific location selected. The server would translate this 
location to a command as intended by the user. A refreshed portion of the virtual 
browser is sent back to the PDA 18 as an image. 

In another embodiment of the present invention, images are only refreshed when 
an event occurs such as a mouse down event on a link or in a text box. 

In a further embodiment only those portions of the image that changes may be 
transmitted from the host computer to the PDA device. Other images in the 
virtual browser that are continuously changing, such as banner advertisements, 
may be the only other images sent to the PDA device as they change. 

The PDA device only contains enough memory to store the current displayable 
page. When the user presses a back or forward button, a message is sent to the 
host server, and the host server sends the reference page. The back and 
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forward buttons etc. may be hard wired into the PDA device, or may be part of 
the display area. 

Further to this, parts of the image representing buttons (and other elements) on 
the virtual browser may be sent as part of the compressed image and buttons 
such as forward and back may be treated the same way as links are handled as 
previously described. In the principle embodiment therefore the back and 
forward buttons are hard coded as part of the device. 

In another embodiment, the PDA device comprises a modem that permits the 
device to connect to a cellular telephone in digital format. 

In another embodiment, the connection to the cellular telephone is made through 
an analog modem connected to an ear jack of the cellular telephone. 

In yet another embodiment of the present invention,. the modem is replaced by an 
analog modem that has the capability to be connected to a landline providing a 
standard 56kbps-type connection. , 

Further embodiments may provide connections through ISDN, cable modems 
etc. 

In a further embodiment, the PDA device may contain a large screen to be used 
in a fashion similar to a home Internet appliance. 

The invention has been described in detail with particular reference to the 
preferred embodiments thereof, but it will be understood that variations and 
modifications can be effected within the spirit and scope of the invention. 
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I claim: 



1 . A host computer system such that it receives information from the outside, 
rasterizes it, compresses the rasterized image and transmits it to a device, 
which decompresses that image and displays it on a screen. 

2. A host computer system that receives a compressed image from the outside, 
decompresses it then recompresses it and transmits it to a device, which 
decompresses that image and displays it on a screen. 

3. A device as claimed in claims 1 or 2 such that text characters selected by a 
user appear in a text area and are immediately rendered by the device which 
creates a bitmap showing it on the display screen. 

4. A device as claimed in claims 1 or 2 such that all text and graphics received 
by the host computer is rendered entirely by a browser into a single image in 
its memory onto a virtual display, of a reduced color depth whereby this 
reduced image is further subdivided impartially into smaller segments, 
which are compressed and sent to a remote device which is capable of 
receiving, storing into memory, decompressing and displaying an assembled 
image to a user. 
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